Journal: bioRxiv
Article Title: Task-driven neural network models predict neural dynamics of proprioception
doi: 10.1101/2023.06.15.545147
Figure Lengend Snippet: A. Diagram of the computational pipeline to compute realistic synthetic proprioceptive inputs from 3D character trajectories. In brief, 2D character trajectories are augmented and projected into 3D space using a 2-link 4 degree of freedom (DoF) arm model by randomly selecting candidate starting points in the workspace of the NHP arm. From those movements, muscle lengths and velocities are computed using inverse kinematics and musculoskeletal modeling. B. Left: Distribution of joint angles and trajectories in the behavioral (top) and synthetic (bottom) data, illustrating that the movement statistics in the synthetic dataset are designed to (broadly) encompass the biological movements of NHPs during the center-out reaching task. Right: workspace trajectory starting points of the synthetic dataset (blue), encompassing the behavioral workspace (red). Note that experimental centerout trajectories themselves are not part of the synthetic dataset. C. In total, 16 computational tasks were designed to reflect different hypotheses about functional proprioceptive processing. Each hypothesis contains one or several objectives, grouped by similarity. The background of the panel is color coded based on the hypothesis and it will be used throughout the manuscript. For each task, the learning objective is highlighted in red with each arm pictogram. D. Test performance of each network model, on selected tasks (N = 350 models except the autoencoder task where N=295), with respect to the number of layers (i.e. model depth). For the regression tasks, we used the mean squared error (MSE), for the action recognition task, the classification accuracy, for the autoencoder task, the relative error for the muscle length and for the redundancy reduction task, the Barlow loss (See methods). Four types of deep neural network architectures were designed to integrate proprioceptive signals in different ways: spatial-temporal, temporal-spatial, and spatiotemporal TCNs, and spatial-LSTM. The color code of each point reflects the architecture type.
Article Snippet: Using these end-effector trajectories, we generated realistic proprioceptive stimuli as done for the data from the center-out reaching task using the same OpenSim musculoskeletal model of the macaca mulatta upper limb ( ).
Techniques: Functional Assay